For a global bank we are looking for multiple data engineer for several location (Amsterdam, Bucharest, Warsaw, Katowice)

Role

As a Data Engineer within the bank you will be responsible for the data architecture and infrastructure of a project together with your colleagues. This involves the ingestion, scalable processing and efficiently storing of data as well as the running of machine learning models and setting up of a full data analysis pipeline.

Your passion is to work with the latest and greatest technologies that make working with large amounts of data easy, you’re pro-active in keeping yourself up to date and are always searching for new ways to discover new technologies. You also enjoy laying the architectural foundations for the things you’re working on. You combine both thinking of the future and a hands on, right now attitude. You will work in a team with highly skilled people and enjoy a creative atmosphere where trying things out is encouraged.

A day in the life of a Data Engineer

As a Data Engineer you are the single most important part of the team. Without your work, nothing moves, data sits idle and useless in a DB or even worse: in excel sheets. You are the one combining these sources in real-time, distributed systems to handle large amounts of data loads in no-time. Data scientists, analysts, business users, CEO’s are continuously praising you, thanking you, worshipping you….

That’s when you wake up to go to work. After your morning coffee you sit with data scientists to find the best way to get their models to run in production, leading the way in how to aggregate the data and process it efficiently for each model. You talk to the business to ingest new sources, cleaning and preparing the data and writing the code that connect it to your application. After a lunch break with colleagues you think of a new technology you’d like to try out. You start investigating and write it up for the next experimentation day. At the end of the afternoon you finalize some comments colleagues had on your latest blog post or start building your presentation for the next conference you’re presenting at. As a Data Engineer working at this department, you’ll never get bored with many experienced and skilled engineers around you, the freedom to innovate and to not only use open source tooling, but also contribute and teach about them.

Your work environment

The analytics team is a team of 120 people that has the mission to make the department within the bank data-driven. We do this by combining UX research and engineering with data science to deliver high-value solutions and products for our organization. We work in a fun and creative environment, and we’re dedicated to bringing out the best in both each other and our projects. We have offices in Amsterdam (main office), London, Warsaw (currently building two new teams here), Katowice (Data platform team) and Romania (IT Risk).

Job description

Your passion is to work with the latest and greatest technologies in the field of Data Engineering. You will work as an engineer on different projects within the analytics team. With this team, you will be building new capabilities on the data Engineering part. You will help to launch new initiatives within the bank and support teams and their projects. At this department we always work with agile techniques.

Our Stack

We use (amongst others) the following technologies and frameworks:

Execution:

• Docker / Kubernetes / Openshift

Processing:

• Apache Spark
• Apache Flink
• Apache Airflow

Storage:

• Ceph (S3)
• Apache Kafka
• PostgreSQL
• Apache Cassandra (and other noSQL DBs)
• Apache Druid
• Apache Avro
• Apache Parquet

Programming:

• Scala
• Python
• ReactJS

Data Security and Lineage:

• Apache Atlas
• Apache Ranger

Do you recognize yourself in this profile:

• Knowledge of data manipulation and transformation, e.g. SQL
• Hands-on experience building complex data pipelines e.g. ETL
• Hands-on experience managing and further developing distributed systems and clusters for both batch as well as streaming data (S3/Spark and/or Kafka/Flink)
• Programming in scripting languages, e.g. Python
• Programming in a statically typed language, e.g. Scala
• Experience in setting up both SQL as well as noSQL databases
• Deployment and provisioning automation tools e.g. Docker, Kubernetes, Openshift, CI/CD
• Bash scripting and Linux systems administration
• Security, authentication and authorisation (LDAP / Kerberos / PAM)
• Affinity with Advanced Analytics, Data Science
• Other programming languages: scripting (Ruby, Groovy, …) or statically typed languages (Java, C++, Go, …)

 What do we offer?

Working at the bank means working in a dynamic and international setting. Individual development of our employees is very important and that is why the bank offers excellent courses and programs. You will become a member of the analytics team, a prestigious, no-nonsense and high-output data-science & engineering team. Diva behaviour is not tolerated, neither is underperformance. You will work on the most innovative projects within the bank.